Shared storage systems and methods for collaborative workflows

ABSTRACT

A shared storage system that is optimized for post-production workflows that use NLEs such as Final Cut Pro X, DaVinci Resolve, Premiere and Avid is disclosed. Further, shared storage systems comprising workstations and shared storage systems, such as NAS devices, are disclosed that optimize workstation settings based on a database of optimal configuration settings to provide optimal bandwidth, minimal latency and stable performance for digital content creation/editing workflows that use file exchange between the workstation and the shared storage system. Novel methods and systems for storage systems are disclosed that configure and expose share drives in novel ways to facilitate video editing, audio editing and compo siting.

RELATED APPLICATIONS

The present application is a continuation-in-part of U.S. applicationSer. No. 16/351,857, filed Mar. 13, 2019, which is a continuation ofU.S. application Ser. No. 16/123,686, filed Sep. 6, 2018, which claimspriority under 35 U.S.C. § 119 to U.S. Provisional Application No.62/556,690, filed Sep. 11, 2017, the disclosures of which are expresslyincorporated herein.

FIELD OF THE INVENTION

The present invention relates to shared storage systems, such as networkattached storage devices, and particularly to shared storage systems fordigital content creation in a shared workflow environment.

BACKGROUND OF THE INVENTION

Network-attached storage (NAS) refers to the provision of file levelcomputer data storage over a computer network, hereinafter network canbe wired or wireless, that offers data access to heterogeneous networkclients. A network attached storage (NAS) device typically utilizes aspecialized file server or network attached storage system that connectsto the network. A NAS unit is essentially a self-contained computerconnected to a network that supplies file-based data storage services toother devices on the network. A NAS device often contains a reducedcapacity or minimized operating and file management system (e.g., amicrokernel) and normally processes input/output (I/O) requests bysupporting common file sharing protocols such as the UNIX network filesystem (NFS), DOS/Windows, and server message block/common Internet filesystem (SMB/CIFS). Using traditional local area network protocols suchas Ethernet and transmission control protocol/internet protocol(TCP/IP), a NAS device typically enables additional storage to bequickly added to a network.

Specifically, a NAS system may be a high-performance file sharing andstorage device, and users using NAS can share files via an IP network.In particular, NAS devices can be a powerful component of collaborativedigital content creation workflows such as post-production workflows.Multimedia content (e.g., films and television programs) needs to beprocessed before it is released for the enjoyment of the user. Thisprocess known as post production or post processing may comprise manysteps to take the multimedia content from the actual recording to therelease: editing, de-rushing, mixing, addition of digital effects,dubbing, subtitling, sound editing, etc. These steps may be accomplishedby multiple users, working in disparate geographies, using a variety ofprocessing devices (e.g., computer workstations) and specialized postproduction software.

The state-of-the-art software is what is known as non-linear editing(NLE) software such as Final Cut Pro (FCP) or Premiere or Resolve orAvid. Such software has several dedicated editing suites for advancedediting, color correction, graphics, finishing and QC. A shared storagesystem is specially needed for facilities that collaboratively editusing NLEs because of how the NLE needs to be integrated in acollaborative environment to be able to work effectively. Specifically,in a collaborative workflow, NLEs require that several small files,e.g., libraries, projects, databases, are stored on a shared storageserver so that all the users collaborating on the project can sharethese files. In a traditional SAN environment (especially XSANenvironments), NLE, e.g., libraries have a difficult time because SAN'sby nature don't handle small database-driven files well, which isexactly what some NLEs require in order to work quickly and effectively.This causes NLE cache, waveform, and analysis files to perform poorly ina SAN environment.

Thus, there is a need for a shared storage solution that is optimizedfor post-production workflows that use NLEs such as Final Cut Pro X (FCPX). Further, the existing shared storage devices, such as NAS devices,are difficult to configure and no system exists that can provide optimalbandwidth, minimal latency and stable performance when a digital contentcreation/editing workflow is created using a NAS device. The systemdisclosed herein provides an improved shared storage device, such as aNAS device, that addresses these needs and other problems.

SUMMARY OF THE INVENTION

In a first embodiment, the present application provides a method forconfiguring a client workstation with one or more settings for optimumbandwidth, latency and stability for file exchange with a shared storageserver that comprises connecting the client workstation to the sharedstorage server, determining one or more attributes of the clientworkstation, using the one or more attributes of the client workstationto consult a database comprising optimum configuration settings for theclient workstation to determine the one or more settings for optimumbandwidth, latency and stability for file exchange with the sharedstorage server, and modifying the client workstation settings to be oneor more settings for optimum bandwidth, latency and stability for fileexchange with the shared storage server. The one or more attributes ofthe client workstation can be selected from the group comprisingcharacteristics of the central processing unit of the clientworkstation, the characteristics of the memory of the clientworkstation, the characteristics of the operating systems of the clientworkstation, the speed and characteristics of the connection between theclient workstation and the shared storage server. In one embodiment, theshared storage server is a network attached storage device. In oneembodiment, the step of determining one or more client attributescomprises running a system profiler for the client workstation. In oneembodiment, the client workstation is directly connected to the sharedstorage servers. In one embodiment, the client workstation is connectedto the shared storage server through a Thunderbolt adapter.

In a second embodiment the present application provides a network systemthat is configured with one or more settings for optimum bandwidth,latency and stability for file exchange that comprises a clientworkstation, a shared storage server, a connection that connects theclient workstation to the shared storage server, and an applicationresiding on the client workstation that during runtime determines one ormore attributes of the client workstation, using the one or moreattributes of the client workstation consults a database comprisingoptimum configuration settings for the client workstation to determinethe one or more settings for optimum bandwidth, latency and stabilityfor file exchange with the shared storage server, and modifies theclient workstation settings to be one or more settings for optimumbandwidth, latency and stability for file exchange with the sharedstorage server. In one embodiment, the shared storage server is anetwork attached storage device.

In a third embodiment the present application provides a network systemfor collaborative digital content creation workflow that comprises atleast one client workstation that can run an application for digitalcontent creation, a network attached storage device comprising a fastmemory storage pool that can be shared with the client workstation, anda connection connecting the client workstation to the network attachedstorage device, wherein during runtime the application for digitalcontent creation can be set to use the fast storage pool for performingone or more application functions. In one embodiment, the applicationfunction is caching. In another embodiment, the application function isstoring a library. In another embodiment, the application function isstoring a project. In one embodiment, the application is Final Cut Pro.

In a fourth embodiment, the present application provides a networksystem for file exchange, the network system that comprises a firstclient workstation, a shared storage server with more than one Ethernetports, wherein the Ethernet ports are numbered according to a numberingsystem, a connection that connects the first client workstation to afirst Ethernet port on the shared storage server, and an applicationresiding on the client workstation that during runtime determines thenumber of the Ethernet port that the first client workstation isconnected to and sets the IP address of the Ethernet port to its numberaccording to the numbering system. In one embodiment the network systemsfurther comprises a second client workstation, and a connection thatconnects the second client workstation to a second Ethernet port on theshared storage server, an application residing on the second clientworkstation that during runtime determines the number of the Ethernetport that the second client workstation is connected to and sets the IPaddress of the Ethernet port to its number according to the numberingsystem.

In a fifth embodiment, the present application provides a network systemfor file exchange that comprises a client workstation, a shared storageserver comprising a first storage volume and a second faster storagevolume, wherein one or more data files reside on the first storagevolume, a connection that connects the client workstation to the sharedstorage server, and an application residing on the shared storage serverthat during runtime determines the type of data file being accessed bythe client workstation and depending on the determined type of file,makes a decision about moving the data file to the second faster storagevolume. In one embodiment, the shared storage server is a networkattached storage device. In one embodiment, the first storage volumecomprises hard disk drives. In one embodiment, the second storage volumecomprises solid state drives.

In a sixth embodiment, the present application provides a network systemfor collaborative digital content creation workflow that comprises atleast one client workstation that can run an application for digitalcontent creation that requires access to an application database, anetwork attached storage device comprising a storage pool that can beshared with the client workstation, wherein the storage pool has storedon it the application database and a connection connecting the clientworkstation to the network attached storage device, wherein duringruntime the application for digital content creation can be set to usethe application database that is stored on the storage pool of thenetwork storage device. In one embodiment, the application is Da VinciResolve.

BRIEF DESCRIPTION OF THE DRAWINGS

Features and advantages of the present invention will become appreciatedas the same become better understood with reference to thespecification, claims, and appended drawings wherein:

FIG. 1 is a block diagram illustrating an exemplary network attachedstorage device according to one embodiment of the present application.

FIG. 2 is a block diagram illustrating an exemplary share applicationflow chart according to one embodiment of the present application.

FIG. 3 is a flow diagram of a process for creating shares.

FIG. 3A is the back end of an exemplary network attached storage deviceaccording to one embodiment of the present application that illustrateshow Ethernet ports on the device are assigned user numbers.

FIG. 3B-3G are various query forms of one embodiment of the shareapplication of the exemplary system.

FIG. 4 is a flow chart of an exemplary embodiment of the optimizationmodule of the exemplary system.

FIG. 5 is a flow chart of an exemplary embodiment of the predictivecaching module of the system.

FIG. 6 is an exemplary post-production workflow implemented using anembodiment of the shared storage servers of the present application.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following description of exemplary embodiments, reference is madeto the accompanying figures in which it is shown by way of illustrationcertain specific embodiments in which the present application can bepracticed. It is to be understood that other embodiments can be used andstructural changes can be made without departing from the scope of thepresent invention.

As used herein, the terms “application,” “computer program” and“software” include without limitation any sequence of human or machinerecognizable steps that are adapted to be processed by a computer. Suchmay be rendered in any programming language or environment including,without limitation, C/C++, Fortran, COBOL, PASCAL, Perl, Prolog, Python,MATLAB, assembly language, scripting languages, markup languages (e.g.,HTML, SGML, XML, VoXML), functional languages (e.g., APL, Erlang,Haskell, Lisp, ML, F# and Scheme), as well as object-orientedenvironments such as the Common Object Request Broker Architecture(CORBA), Java® (including J2ME, Java Beans, etc.).

As used herein, the term “display” includes any type of device adaptedto display information, including without limitation cathode ray tubedisplays (CRTs), liquid crystal displays (LCDs), thin film transistordisplays (TFTs), digital light processor displays (DLPs), plasmadisplays, light emitting diodes (LEDs) or diode arrays, incandescentdevices, and fluorescent devices. Display devices also include fewerdynamic devices such as printers, e-ink devices, and other similarstructures.

As used herein, the terms “local” and “remote” refer generally todevices, entities, or users that are serviced by separate sets ofprocesses. These terms are intended to be relative, and bear no absolutereference or connotation to the physical location of the executedprocesses of the served device, entities, or users.

As used herein, the term “module” refers to any type of software,firmware, hardware, or combination thereof that that implements aspecific functionality or theme.

As used herein, the term “network” refers generally to any type oftelecommunications or data network including, without limitation, cablenetworks, satellite networks, optical networks, cellular networks, andbus networks (including MANs, WANs, LANs, WLANs, internets, andintranets). Such networks or portions thereof may utilize any one ormore different topologies (e.g., ring, bus, star, loop, etc.),transmission media (e.g., wired/RF cable, RF wireless, millimeter wave,hybrid fiber coaxial, etc.) and/or communications or networkingprotocols (e.g., SONET, DOCSIS, IEEE Std. 802.3, ATM, X.25, Frame Relay,3GPP, 3GPP2, WAP, SIP, UDP, FTP, RTP/RTCP, TCP/IP, H.323, etc.).

As used herein, the term “network interface” refers to any signal ordata interface with a component or network including, withoutlimitation, those compliant with USB (e.g., USB2), FireWire (e.g., IEEE1394b), Ethernet (e.g., 10/100, 10/100/1000 Gigabit Ethernet, 10-Gig-E,etc.), MoCA, Serial ATA (e.g., SATA, e-SATA, SATAII), Ultra-ATA/DMA,Coaxsys (e.g., TVnet™), radio frequency tuner (e.g., in-band or OOB,cable modem, etc.), modem, Wi-Fi (802.11a,b,g,n), WiMAX (802.16), PAN(802.15), or IrDA families.

As used herein, the terms “processor,” “microprocessor,” and “digitalprocessor” include all types of digital processing devices including,without limitation, digital signal processors (DSPs), reducedinstruction set computers (RISC), general-purpose (CISC) processors,microprocessors, gate arrays (e.g., FPGAs), programmable logic devices(PLDs), reconfigurable compute fabrics (RCFs), array processors, andapplication-specific integrated circuits (ASICs). Such processors may becontained on a single unitary IC die or distributed across multiplecomponents.

As used herein, the term “storage pool” refers to storage media forstoring digital data including, without limitation, solid state drives(SSD) including non-volatile memory express SSDs (NVMe/SSDs), magneticstorage media including, without limitation, hard disk drives, opticaldrives, or tape drives.

As used herein, the term “storage server,” “shared storage server,”“shared storage,” “server,” and “network attached storage” are usedinterchangeably and refer to any computerized component, system orentity, regardless of form, which is adapted to provide data, files,applications, content, or other services to one or more other devices orentities on a computer network.

As used herein, the term “wireless” refers to any wireless signal, data,communication, or other interface including, without limitation, Wi-Fi,Bluetooth, 3G, HSDP/HSUPA, TDMA, CDMA (e.g., IS-95A, WCDMA, etc.), FHSS,DSSS, GSM, PAN/802.15, WiMAX (802.16), 802.20, narrowband/FDMA, OFDM,PCS/DCS, analog cellular, CDPD, satellite systems, millimeter wave ormicrowave systems, acoustic, and infrared (i.e., IrDA).

FIG. 1 is a schematic illustration of one embodiment of a networkattached storage (NAS) device 100, which may be used to implement one ormore of the network attached storage devices depicted in FIG. 6.Referring to FIG. 1, NAS device 100 comprises one or more networkinterfaces 110 which enables a communication connection directly with aclient workstation or through a network (e.g., one or more devicesconnected to the NAS via a switch).

Network interface 110 may comprise one or more input/output (I/O) portsto provide a physical connection with a client workstation or a network.For example, network interface 110 may comprise one or more Ethernetports. The back end of an exemplary embodiment of the system shown inFIG. 3A, comprises eight Ethernet ports. Network interface 110 maycomprise a network interface card (NIC), also commonly referred to as anetwork adapter or a network card. The NIC manages I/O operations toenable NAS device 100 to communicate with a client workstation or anetwork connected to the NAS. Alternatively, the operations of the NICmay be implemented on a main circuit board such as, e.g., a motherboardof NAS device 100.

NAS device 100 further comprises at least one processor 120. As usedherein, the term “processor” means any type of computational element,such as, but not limited to, a microprocessor, a microcontroller, acomplex instruction set computing (CISC) microprocessor, a reducedinstruction set (RISC) microprocessor, a very long instruction word(VLIW) microprocessor, or any other type of processor or processingcircuit.

NAS device 100 further comprises system random access memory (RAM) 130of 1 gigabyte or more. In certain embodiments the RAM may be 64gigabytes. In certain embodiments, the RAM may be 800 gigabytes. It mayadditionally or alternatively comprise read-only memory (ROM). Memory130 comprises an operating system 160 for managing operations of NASdevice 100. In one embodiment, operating system 160 comprises a hardwareinterface module 170 that provides an interface to system hardware. Theparticular embodiment of operating system 160 is not critical to thesubject matter described herein. The server, e.g., NAS device 100, withits storage subsystem 180 (discussed below) and connections to a clientworkstation or a network, preferably, runs the Linux operating system160 (or, equivalently running a Unix or like Unix variant operatingsystem, including Apple's OS X, or a Windows brand operating system,which can run the software and hardware as described herein below).

ZFS architecture: An exemplary operating system 160 of the presentapplication uses ZFS architecture (“ZFS”) to administer data storage onthe storage media, which is a robust, versatile file system and logicalvolume manager that administers file systems. ZFS uses a 128-bitaddressing scheme and can store up to 275 billion TB per storage pool,and is a product of Oracle Corporation of Redwood Shores, Calif. A fullexplanation of the ZFS architecture is available in a white paperentitled Architectural Overview of the Oracle ZFS StorageAppliance—ORACLE WHITE PAPER|FEBRUARY 2018, the disclosure of which isexpressly incorporated herein.

Use of ZFS allows pooled storage, where all available hard drives in thestorage system are essentially joined together. The combined bandwidthof the pooled devices is available to ZFS. ZFS takes available storagedrives and pools them together as a single resource, called a “zpool”.This can be optimized for capacity, I/O performance or redundancy, usingstriping, mirroring or some form of redundant array of independent disks(RAID). In computer storage, the standard RAID levels comprise a basicset of RAID configurations that employ the techniques of striping,mirroring, or parity to create large reliable data stores from multiplegeneral-purpose computer hard disk drives (HDDs). If more storage isneeded, then more drives can simply be added to the zpool: ZFS sees thenew capacity and starts using it automatically, balancing I/O andmaximizing throughput. Instead of pre-allocating metadata like otherfile systems administrators, ZFS utilizes dynamically allocated metadataas needed, with no initial space required at the initialization and nolimit on the files or directories supported by the file system. There isno need to predetermine the size of a file system, as file systems growautomatically within the disk space allocated to the storage pool. Whennew storage is added, all file systems within the pool can immediatelyuse the additional disk space without additional work.

ZFS ensures that data is always consistent on the disk using a number oftechniques, including copy-on-write. Thus, when data is changed it isnot overwritten—it is always written to a new block and check summedbefore pointers to the data are changed. The old data may be retained,creating snapshots of the data through time as changes are made. Filewrites using ZFS are transactional—either everything or nothing iswritten to disk. ZFS can be scheduled to perform a “scrub” on all thedata in a storage pool, checking each piece of data with itscorresponding checksum to verify its integrity, detect any silent datacorruption and to correct any errors where possible.

When the data is stored in a redundant fashion—in a mirrored orRAID-type array—it can be self-healed automatically and without anyadministrator intervention. Since data corruption is logged, ZFS canbring to light defects in memory modules (or other hardware) that causedata to be stored on hard drives incorrectly. Scrubbing is given low I/Opriority so that it has a minimal effect on system performance and canoperate while the storage pool is in use. An advantage of copy-on-writeis that, when ZFS writes new data, the blocks containing the old datacan be retained, allowing a snapshot version of the file system to bemaintained. ZFS snapshots are created very quickly, since all the datacomposing the snapshot is already stored. They are also space efficient,since any unchanged data is shared among the file system and itssnapshots. Initially, snapshots consume no additional disk space withinthe pool. As data within the active dataset changes, the snapshotconsumes disk space by continuing to reference the old data. As aresult, the snapshot prevents the data from being freed back to thepool. ZFS also allows writeable snapshots (“clones”) to be created,resulting in two independent file systems that share a set of blocks. Aschanges are made to any of the clone file systems, new data blocks arecreated to reflect those changes, but any unchanged blocks continue tobe shared, no matter how many clones exist. This is possible due to thecopy-on-write design. Snapshots of ZFS file systems and volumes can besent to remote hosts over the network. This data stream can be an entirefile system or volume, or it can be the changes since it was last sent.When sending only the changes, the stream size depends on the number ofblocks changed between the snapshots. This provides a very efficientstrategy for synchronizing backups.

ZFS Caching: ZFS architecture includes “adaptive replacement cache” orARC that is a very fast block level cache located in the system'smemory. In the embodiment shown in FIG. 1, this is the L1 Cache 164. Anyread requests for data in the cache can be served directly from the ARCmemory cache instead of the much slower hard drives that improvesperformance for data that is accessed frequently. In some embodiments ofthe system the RAM is 64 gigabytes or more, and even 800 gigabytes ormore allowing the ARC, L1 Cache, to be set at a very high value. ZFSarchitecture also includes L2ARC, the second level adaptive replacementcache, shown as L2 Cache 184 in FIG. 1. The L2 Cache is a part of theFlash Storage Pool 181, which, for example, is comprised of NVMe/SSDsand is described below. The L2ARC is often called the “cache drive” inZFS systems. The algorithms that manage L2ARC population are automaticand intelligent. In accordance with the present application, with the L2Cache present in the ZFS pool, the L2 Cache will cache frequentlyaccessed data that did not fit in ARC. When read requests come into thesystem, ZFS will attempt to serve those requests from the L1 Cache. Ifthe data is not in the L1 Cache, ZFS will attempt to serve the requestsfrom the L2 Cache. Hard drives are only accessed when data does notexist in either the L1 Cache or L1 Cache. This means the hard drivesreceive far fewer requests that can have a dramatic improvement onperformance.

The present application also provides a Write Buffer 185 in the FlashStorage Media 181 to serve as the “ZFS intent log” (“ZIL”) that acts asa logging mechanism to store synchronous writes, until they are safelywritten to the main data structure on the storage pool. The speed atwhich data can be written to the ZIL determines the speed at whichsynchronous write requests can be done. By using NVMe/SSDs as the ZIL,the exemplary system accelerates the ZIL and improves synchronous writeperformance. Like L2 Cache 184, the Write Buffer 185 is managedautomatically and intelligently by ZFS. Thus, by using the NVMe/SSDs forboth the L2ARC and the ZIL in accordance with one embodiment of theexemplary system, both read and write data is accelerated.

Further, the NAS Device 100 includes a Network File Protocol module 165,which is a service that runs on the NAS device for enabling fileexchange. In accordance with the present application, this protocolimplements one or more of Network File System (NFS) protocols, anSMB/Common Internet File System (CIFS) protocol, an AFP protocol, aniSCSI protocol, or the like.

In one embodiment, the operating system 160 may comprise a file cachemanagement system 163. File cache management system 163 interfaces withthe operating system(s) 160 to manage the L1 Cache 164, L2 Cache 184 andWrite Buffer 185 as resources for the NAS Device 100.

Operating system 160 further may comprise a system call interface module161 that provides an interface between the operating system 160 and oneor more application modules, e.g., predictive cache module, that executeon NAS device 100.

NAS device 100 further comprises storage subsystem 180 for storingdigital media files and other data and preferably providing terabytes topetabytes of storage capacity, for example, a storage subsystem 180comprising a HDD storage pool 182, which consists of hardware deviceinterface cards which are attached both to 32-bit PCI or 64-bitPCI/PCI-X/PCI-Express slots on the motherboard and to high-capacityinternal hard drives (e.g., 12 Gb SAS or Serial ATA drives), and/or aflash storage pool 181 consisting of SSD, preferably NVMe/SSDs, memorycards which are connected to the server motherboard. Thus, the storagesubsystem 180 may comprise storage media including, but not limited to,hard disk drives, magnetic disks, tape drives, optical storage drives,and solid-state drives (SSD), for example, NVMe/SSDs and memory cards,etc. As would be known to skilled artisans, the hardware architecturemay alternately comprise media access control devices configured tosupport IDE, SCSI, Fibre Channel, Firewire, and USB devices, protocolsand topologies. Regardless of the storage media controller contemplated(e.g., SAS, SATA, IDE, or SCSI) it can control one or more storage mediadrives 181, 182 configured in and/or connected to the server. It shouldbe understood that any combination of storage media drives iscontemplated. For example, storage subsystem 180 may be embodied as oneor more arrays of magnetic disk drives, for example, a hard disk drive(HDD) storage pool 182. Alternatively, or additionally storage subsystem180 may comprise solid state drives (SSD), optical, magneto-optical, orelectro-optical storage media. For example, storage subsystem 180 maycomprise NVMe/SSDs flash storage pool 181. In various embodiments,storage subsystem 180 may comprise only flash storage pool or only adisk storage pool or it may be a hybrid of the two as shown in FIG. 1.Storage subsystem 180 may be configured to implement RAID redundancy.

As shown in FIG. 1, in one embodiment of the exemplary system thestorage subsystem 180 comprises a flash storage pool 181 comprised of,e.g., NVMe/SSDs. The flash storage pool is further comprised of L2 Cache184, Write Buffer 185, S1 Storage Pool 186 and S2 Storage Pool 187.

Share Application: In one embodiment, the workstation that is connectedto the shared storage server, for example, NAS device 100, has installedon it a computer program that is referred to as the “share application”of the exemplary system herein, the logic flow for an embodiment ofwhich is illustrated in FIG. 2. The share application provides multiplefunctionalities: finding the shared storage server, e.g., the NAS 100 ofthe exemplary system, using a modified bonjour type of software module,mounting of the shared storage server of the system as one or moreshared drives onto the client's computers and network, using attributesof the client's workstation for optimizing client file sharing settingsto maximize available bandwidth, minimize latency and maximizestability, and for Apple Macintosh computers, file searching capabilityusing Spotlight.

In an exemplary embodiment, the server broadcasts its existence using amodified bonjour protocol to all devices connected to the server.Bonjour is Apple's implementation of zero-configuration networking(zeroconf), a group of technologies that includes service discovery,address assignment, and hostname resolution. Bonjour locates devicessuch as printers, other computers, file-sharing servers and the servicesthat those devices offer on a local network. While there is Bonjour forWindows, Microsoft does have its own implementation ofzero-configuration networking referred to as Automatic Private IPAddressing (APIPA) or Internet Protocol Automatic Configuration (IPAC).More well known, Universal Plug and Play (UPnP) is a set of networkingprotocols that permits networked devices, such as personal computers,printers, Internet gateways, Wi-Fi access points and mobile devices toseamlessly discover each other's presence on the network and establishfunctional network services for data sharing, communications, andentertainment. These will all be referred to as bonjour type of softwaremodules, and the present application implements a modified bonjourprotocol.

In operation, a client workstation is connected to a shared storageserver of the exemplary system, e.g., the NAS device 100, over adirectly connected wire or over a network (e.g., via a switch). Forinstance, a client workstation may be remote and be able to access theNAS device 100 via the share application which is web-based. The clientworkstation implements the share application according to the logic flowillustrated in FIG. 2.

Create Shares: Prior to any downstream users being given access, theshares themselves must be created on the server. A “share” is a term fora folder on the server than can be shared by multiple clients, meaningthat various clients may read and write to files and execute programsthat reside in the shared folder. Such files/programs may be related toa unique project such as a film or a scene in a film, or the sharedfolder may contain all media and files/programs owned by a singlecompany or division therein. The example of film content is used, thoughthe same technique for sharing media and files may be useful for avariety of end products, such as other entertainment projects,advertising, multimedia presentations, musical scores, graphic novels,etc. When an administrator creates a share, the share must be instructedto provide various permissions for various end-users, as will bedescribed below.

FIG. 3 is a flow diagram of the process for creating shares. The NAS ofthe exemplary system supports both NFS and SMB network protocols forfile sharing, and so at steps 300 and 302 the process starts with acommand to create a share with one or the other. At step 304, the usergets to name their share in a way it will show up in their shareapplication and as a shared device on their client computers. Next, theshare application creates a new dataset using the entered name at step310, sets default permissions at 312 and default settings optimized forthe task in step 314 (in this case for video post-production). The shareapplication then creates a new mountpoint in step 320 and a discreteshare under the assigned name in step 322. The share is linked to amountpoint in step 324 and then default optimizations of the NAS device100 are set for SMB and NFS shares, depending on the protocol, in step326.

System Operation: When an administrator or end-user first connects tothe NAS device 100, the share application determines at 200 if theclient workstation has previously been configured by the shareapplication. If it has been configured (YES at 200), the applicationruns a process at 202 to autodetect the NAS device (server). If the NASdevice is detected (YES at 204), the client workstation can mount theNAS device's available shares to share files between the workstation andthe NAS device, described below. If the share application cannotautodetect the NAS device (NO at 204), or if the user so chooses, itwill run a process at 206 to manually detect the NAS device. Thisprocess may require user input in response to queries such as “Is thisNAS device directly attached” or “is the NAS device on a switch.” Itwill guide the client workstation user through queries until it detectsthat there is a NAS device connected or it can confidently say thatthere is no NAS device connected.

If the share application determines that the client workstation has notbeen configured by the application, (NO at 200), the application againruns a process at 202′ to autodetect the NAS device (server). If the NASdevice is detected (YES at 204′), the application will run aconfiguration process to configure the workstation by going into autoconfiguration mode, or a manual setup may be chosen, described below. Ifthe share application cannot autodetect the NAS device (NO at 204′), itwill again run a process at 206′ to manually detect the NAS device untilit detects that there is a NAS device connected or it can confidentlysay that there is no NAS device connected.

If the share application determines that the client workstation has notbeen configured by the application (NO at 200) and the server isdetected (either automatically or manually), the share application willrun a configuration process. An automatic setup at 210 or a manual setupat 212 will put all the workstation configuration settings in place: theclient workstation IP addresses will be modified in accordance with anembodiment of the present application described with reference to FIGS.3A-3G below, change the workstation host file, and optimize theworkstation NFS and/or SMB settings for optimal file sharing between theworkstation and the NAS device at 213 in accordance with an optimizationmodule of the exemplary system, as described below with respect to FIG.4. It can also optimize NIC driver settings.

The automatic setup at 210 triggers the client computer to scan for anetmask and a netbios name that are indicative for the presence of a NASdevice (server). The share application recognizes the network interfaceused on the client computer to connect to the NAS device, and modifiesthe IP address and subnet mask of that interface, as well as certainadvanced settings such as the network speed that is negotiated by theclient and server devices and the MTU/Jumbo Frames. In the process ofAuto Setup 210, the share application also modifies the host's file onthe client computer. That way the IP address of the client computer isgiven a range of names that are used later in interacting with the NASdevice(s), which is done for ease of use of the customer.

Share Application IP Address Translation: The share application of theexemplary system predefines IP addresses based on the user number of aclient workstation connected to the shared storage server of the system,e.g., NAS device 100. The user number is determined simply by theEthernet port to which the client workstation is connected. FIG. 3Ashows the back end of a shared storage server of the exemplary system,e.g., NAS device 100. In an exemplary embodiment according to FIG. 3A,user numbers are assigned top to down and left to right in the order ofthe Ethernet ports where the workstations are connected to the NASdevice. Thus, the topmost connection is “User 1”, the one below it is“User 2”, the one below it is “User 3”, the one to the right of that is“User 4”, the one below the “User 3” port is “User 5” and the ones tothe right of that are “User 6”, “User 7” and “User 8”, going left toright, sequentially. So, the end user does not need to know the IPaddress to connect to the NAS. The pseudo IP address is simply thenumber of the port to which the client computer is connected. Then theapplication translates the IP addresses of the eight Ethernet ports ofthe above example to be simply 1, 2, 3, 4, 5, 6, 7, and 8. Thesepredefined IP addresses are used throughout the share applicationinstead of actual IP addresses.

Thus, as shown in FIG. 3B, instead of providing actual IP addresses (asin prior art), the user of a client workstation connected to the NASdevice needs to provide the share application only the Ethernet port onthe NAS device to which the workstation is connected. FIG. 3B also showsin a pop-up graphic the numbering scheme for ports to which users areconnected, again sequentially from top to bottom and left to right. Itwill be understood by one of skill in the art, that any other numberingscheme for ports may be used. For example, increasing sequence frombottom to top and right to left and other variations. The key point isthat the connection ports to which user workstations are connected haveunique numbers and then for purposes of the share application the IPaddress of the port to which a user is connected is simply the portnumber to which the user is connected.

Once the user enters the port number, the share application will lookfor the share storage server, e.g., Jellyfish, a NAS device, in FIG. 3C.Jellyfish is a share storage server available from LumaForge, Inc. ofBurbank, Calif. If the share application is unable to locate the server,the user will be prompted to choose a setup option, FIG. 3D. The userwill have the option of automatic setup or manual setup as shown in FIG.3E. If the automatic setup fails, the user also has the option ofmanually setting up and locating the server, e.g., the Jellyfish NASdevice. Choosing the manual option requires the user to enter the IPaddress, netmask and ID information as shown in FIG. 3F.

In an alternative embodiment, the share application automaticallysearches for the shared storage server, e.g., NAS device 100, to which aworkstation is connected, automatically determines the Ethernet port ofthis connection and then automatically configures the client workstationfor optimum file transfer with the NAS device.

Once the configuration has been set, the user will be able to see theavailable shares as shown in FIG. 3G. Here the user can mount any of theavailable shares by turning on the appropriate switch.

In one embodiment of the present application, the host file entry is setso that instead of using an IP address to identify the server, e.g., NASDevice 100, the user just types in the name of the server, e.g.,ShareStation or Jellyfish, in the workstations browser or Finder (forMac OS workstations) or Windows Explorer. Because the name of the serveris in the host file, the workstation will translate the server name,e.g., Jellyfish, into a proper IP address.

Mounting Shares: As mentioned, the share application enables anadministrator to manage permissions of various potential users on theserver side for various shares. Such permissions as read, write andexecute are toggled ON/OFF for each user. When a particular userconnects to the NAS device 100, he or she sees each share folder and mayhave permission to mount the folder to see and edit various filestherein as permitted. By setting up these permissions in advance, theshare application greatly simplifies the hierarchy of permissions foreach share folder for multiple users, that previously would haverequired an IT professional to manage an access control list (ACL)involving numerous check boxes at the root level.

After configuration, auto or manual, the workstation user will be ableto see the list of available shares and turn them on or off (mounting)using, e.g., a switch. In one embodiment of the present application, theavailable shares are mounted using a switch rather than a button. Theswitch also quickly tells the user whether a share is mounted or not asshown in FIG. 3G. For example, if a share is unmounted, e.g., because awire came loose, the switch will change color to tell the user that theshare is unmounted. The switch allows the share application to providethe real state of the server (even if there is a problem with the clientOS, for example) to the workstation user.

Shares may be mounted manually or automatically, as indicated in FIG. 2at 214 and 216. If the user must mount the shares manually, option 218provides the ability to set the system to automatically mount the sharesin the future.

Optimization Module: When a workstation is connected to an NAS, it doesnot yield optimal performance. The default settings on the clientworkstation are not optimized for maximizing throughput, reducinglatency and increasing stability, i.e., default settings used by theclient workstation's operating system are not optimal for file sharingbetween the client workstation and a shared storage server such as theNAS device 100. The best that has been done in the prior art is tomanually configure client workstations in a hit and miss system forconnection to a NAS. In general, such manual methods do not yieldoptimal settings. The methods provided herein allow an applicationresiding on the client workstation, e.g., an optimization module in theshare application of the exemplary system, to configure it optimally sothat its connection to the NAS provides the optimal bandwidth, minimumlatency and maximum stability for file sharing. The present systemarrives at the optimal values by analyzing the client workstation, andconnection settings between the client workstation and the server. Ifthe server is connected to the client workstation via an adapter, theexemplary system also analyzes the connection settings between theclient workstation and the adapter and/or the connection settingsbetween the server and the adapter.

FIG. 4 illustrates the flow chart of an exemplary embodiment of theoptimization module of the present application. As set forth above,prior to execution of the optimization module, the share applicationrunning on the client workstation has detected that the clientworkstation is connected to an NAS device. In a first process, theoptimization module runs the system profiler and extracts various clientworkstations attributes, for example, characteristics of the CPU, theoperating system, including its specific version, the characteristicsand amount of RAM, and the type and speed of the connection between theworkstation and the NAS device. In a second process, the optimizationmodule runs an algorithm using client workstation attributes and anempirically determined database to determine the client workstationconfiguration that will be optimal for file sharing between the clientworkstation and the NAS server. In one embodiment, the algorithm usesthe client workstation attributes to calculate a score. The score isthen used to look up an empirical database to determine the optimalsettings for the client workstation configuration to provide maximumbandwidth, minimum latency and maximum stability. In one embodiment, thelook-up process is implemented in a series of IF-THEN statements. In athird process, the optimization module runs a process to set the clientworkstation configuration settings to the optimal settings. In oneembodiment, the settings that the optimization module optimizes are NFSand SMB settings such as ReadAhead, the size of the read/write buffer,the NIC buffers, ring size, MTU size, etc.

Thus, the present application provides a method of dynamic optimizationof the client workstation configuration when the client workstation isconnected to a NAS. The system automatically configures the clientworkstation to provide optimum performance with respect to bandwidth,latency and stability for file exchange between a NAS server, that ofthe present system or another NAS server, and the workstation. Theoptimized settings maximize throughput, reduce latency and increasestability.

The optimization module of the exemplary system can be used for variousworkstation-NAS device connection types and speeds. The optimizationmodule includes the optimum configuration settings for a workstationconnected to an NAS device via an intermediate adapter, e.g., aThunderbolt adapter. Thunderbolt adapters combine PCI Express(PCIe—high-speed serial computer expansion bus standard) and DisplayPort(DP—digital display interface) into two serial signals, and additionallyprovides DC power, all in one cable. Up to six peripherals may besupported by one connector through various topologies. ExemplaryThunderbolt adapters are Sonnet, Promise, SmallTree, etc. In anotherembodiment, the module can be used where the workstation is directlyconnected to the NAS device. For example, the next generation Maccomputers announced by Apple Computers will eliminate the need for anexternal adapter and allow the NAS device to be directly connected tosuch Macs. Because the attributes of the network cards on the Mac Pro orthe iMac are known, the optimum configuration settings for the known Macnetwork cards have been determined and the optimization module can beimplemented where a Mac is directly connected to an NAS device withoutan external intermediate adapter.

Metadata Share Volume: In some embodiments of the present application,the shared storage server of the system, e.g., NAS device 100, comprisesa high speed, high performance flash storage pool 181. This may becomprised of, for example, NVMe/SSDs. The present system separatelydesignates at least a part of this storage pool as a separate share S1Storage Pool 186, which means that it is separately exposed to a clientworkstation as a separate share volume, for example, as a metadata sharevolume. Many applications, including, without limitation, NLEs, audioediting applications, and compositing applications, require their owncaches for storing small files such as libraries, projects or databaseattributes. For example, Final Cut Pro X requires that the user specifya cache for the program. On a standalone workstation not connected to ashared storage device, the user usually specifies the workstations localstorage as the cache. However, this will not work in a collaborativeworkflow because the cache contents will only be available to the useron that workstation. The exemplary system permits such collaborativeworkflow by providing the metadata share volume, e.g., S1 Storage Pool186. Multiple Final Cut Pro X users connected to the shared storage cannow work collaboratively by mounting the metadata share volume andspecifying that the cache for the Final Cut Pro X (FCP X) program is themetadata share volume, e.g., S1 Storage Pool 186. Similarly, themetadata share volume, once mounted on a workstation, can be set as thecache for other NLE programs such Premiere Pro, Resolve, etc., or forother applications that require their own caching such as audio editingprograms, or compositing applications, which need layer caches, rendercaches, etc. When user applications require one or more, and sometimesseveral, small files such as libraries, project files, etc., themetadata share volume of the exemplary system provides a high speed, lowlatency share volume for such files and, thus, makes collaborativeworkflow feasible. When a number of client workstations are connected tothe same NAS device and working on the same project (say using FCPX)—the latency would be significantly improved if they all mounted themetadata share volume and instructed the FCP X to use this volume forcaching. The latency can be reduced, for example, from a millisecond toa microsecond. In summary, the metadata share volume is visible as aseparate share in the share application of the exemplary system.Therefore, if needed the metadata share volume, e.g., S1 Storage Pool186, can be mounted and used by the client workstation for variousapplications where the workflow would benefit from shared caching.

In an exemplary embodiment, the server device 100 includes at least tenGigabit Ethernet network adapters having integrated Gigabit Ethernet MACand PHY layer functions. Such a system—along with the storage subsystemdiagramed—allows for sufficient data transfer between the server andworkstations to support multiple NLE workstations or other networkcapable hardware such as, but not limited to, encoders, playout servers,and video recorders that play from and record to devices such as harddrives simultaneously accessing media files on the storage subsystem.

Cache memory: Also called CPU memory, cache memory is high-speed staticrandom-access memory (SRAM) that a computer microprocessor can accessmore quickly than it can access regular random-access memory (RAM).Cache memory is typically integrated directly into the CPU chip orplaced on a separate chip that has a separate bus interconnect with theCPU. The purpose of cache memory is to store program instructions anddata that are used repeatedly in the operation of programs orinformation that the CPU is likely to need next. The computer processorcan access this information quickly from the cache rather than having toget it from computer's main memory. Fast access to these instructionsincreases the overall speed of the program.

Predictive caching: As seen in FIG. 1, NAS storage device 100 furthercomprises a predictive caching module 140. In some embodiments, thepredictive caching module is embodied as a software module that executeson processor(s) 120. In such embodiments, predictive caching module 140executes as a background process to determine the type of files storedon NAS storage device 100 that are being accessed by clientworkstations. In some embodiments, predictive caching may be used toimprove transfer performance. In one embodiment, for example, trackinglogic may be used to track the type of file being accessed by the clientand/or the type of operation being performed on the file by the client.The results of the tracking analysis may then be used to ensure thatcertain data files, e.g., image sequence files, are pre-read into thecache or moved from slower storage pools to a faster NVMe/SSD pool toallow faster access by the client.

A flow chart of an embodiment of predictive caching is illustrated inFIG. 5. When a client workstation is connected to the server, and theclient workstation initiates a request, the module first runs a process,which determines the type of file being requested by the clientworkstation. If the type of file is such that it does not need caching,for example a document file, the module exits. If the type of file issuch that caching would improve performance, for example, an imagesequence file, the module runs a process to determine the type of actionthat the client workstation is performing on the file. If the type ofaction is such that it does not need caching, for example the action isbrowsing file names, the module exits. If the type of action is suchthat caching would improve performance, the module runs a process tomove the file into the cache. Various other techniques of intelligentcaching may also be utilized according to embodiments of the presentapplication.

As also seen in FIG. 1, NAS storage device 100 may further comprises acontrol module 150 that controls the operation of predictive cachingmodule 140 in response to file access requests from client workstation.

In one embodiment, the NAS server 100 of the exemplary system set forthherein provides a plug-and-play type (mobile) shared storage serversthat can be used by a small to mid-sized groups of editors, VFX artists,colorists, and graphic designers to quickly and efficiently shareprojects and collaborate. In this embodiment the shared storage serverfunctions like a direct-attached storage. It can be preconfigured. Eachclient workstation can run the share application of the exemplary systemto mount and connect to the mobile shared storage server. Once theshared storage server has been mounted, the system can auto-mount everytime after that. The present system comprises features such as a singleclick button that repairs FCPX libraries and allows for relinkingmissing proxies. The mobile shared storage server in one exemplaryembodiment can generate over 1600 MB/s of sustained bandwidth, and itstower and rack clock in at over 7200 MB/s. The system operates withminimal latency. The system uses state-of-the-art parity options anderror-correcting technology to provide data security. The system isfully customizable according to the workflow needs of clients.

As shown in FIG. 6, another computing workflow environment in which thepresent system may be implemented includes a server system comprisingthree storage pools connecting multiple client workstations, e.g.,video-editing client workstations, HD/sound workstations, VFXworkstations. The media data can flow between the server and theworkstations via a switch device that provides 1, 10, 25, 40, 50 and 100Gb Ethernet ports. This switch can provide wired connections directly tovarious workstations to provide the required bandwidth, or throughanother switch (1 Gb Ethernet), which can then provide wired connectionsto various workstations that do not require that high a bandwidth.

As can be seen in FIG. 6, the server system comprises three storagepools: a flash pool comprised of SSDs, preferably NVMe/SSDs, a primarypool comprising spinning disk arrays and an archive pool comprisingspinning disk arrays. The spinning disk arrays can be comprised of, forexample, Ultrastar Helium hard disks with a 12 Gb SAS interface. Thehead unit, equivalent to the memory 130 of FIG. 1 comprises 10, 40 and100 Gb Ethernet ports. The head unit is connected via a 100 Gb Ethernetconnection to a main switch, Main Switch (1/10/25/40/50/100 GbE), thatcontains 1, 10, 25, 40, 50 and 100 Gb Ethernet ports. The main head unitis connected to an archive head unit via a 40 Gb Ethernet connection.

In the embodiment shown, the Main Switch is connected to a secondswitch, Secondary Switch (1 GbE), via a 10 Gb Ethernet connection,wherein Secondary Switch has multiple 1 Gb Ethernet ports. SecondarySwitch can provide 1 Gb Ethernet connections to clients such as HDproducers, or sound producers for them to access the NAS. SecondarySwitch enabling server communications with the client workstations maycomprise a Gigabit switch device such as provided by SMC® (Irvine,Calif.) that supports “Gigabit over Copper” Ethernet as well as “JumboFrames” (defined by a packet size or Maximum Transmission Unit—MTU—of9000). This enables workstations to function at full Gigabit speeds overEthernet cables that allow for maximum data throughput over the networkand minimum use of CPU resources both by the server and workstations inorder to support network transactions.

In the embodiment shown, Main Switch provides a 10 Gb Ethernetconnection to editorial workstations. Further, Main Switch provides a 25Gb Ethernet connection to VFX workstations and provides a 40 Gb Ethernetconnection to workstations for coloring/finishing workflow or from whichmedia is to be ingested, and a 10 Gb Ethernet connection to a mediaasset manager (MAM) server/computer. Main Switch may comprise a Gigabitswitch such as that provided by SMC® (Irvine, Calif.) that supports“Gigabit over Copper” Ethernet as well as “Jumbo Frames” (defined by apacket size or Maximum Transmission Unit—MTU—of 9000). In theillustrated embodiment, the connections between storage pools are 12 Gbserial attached SCSI (SAS) connections. The exemplary embodiment iscompatible with 1/10/40 & 25/50/100 GbE connections, expandable up to100+PB, can provide up to 12,000 MB/s bandwidth, supports many differenttypes of file protocols including, NFS, SMB/AFP/iSCSI, and is optimizedfor NLEs such as FCPX, Adobe CC, Resolve, AVID. With the wide range ofEthernet connections, the NAS can support complex workflows, e.g., onethat require editors, VFX artists, Colorists, graphic designers and anaudio team to work collaboratively on the same project. The NAS alsooffers high availability through the use of redundant head units, aswell as various nearline and backup options.

Thus, in the embodiment of FIG. 6, the present application provides apost-production server that supports a 100 Gigabit Ethernet backbone,which provides an adequate amount of bandwidth with minimal latency andallows various clients to have the necessary connection type to matchtheir workflow whether that's 1/10/25/40 or 50 GbE.

DaVinci Resolve: An exemplary digital mastering system that may beincorporated into the present system is the DaVinci Resolve availablefrom Blackmagic Design Pty. Ltd. of Port Melbourne, Australia. DaVinciResolve is a scalable GPU-based color grading and digital masteringsystem which offering multiple levels of acceleration, features andcapabilities, providing colorists with exacting and intuitive colorcontrol over static or moving objects.

Preloaded DaVinci Resolve Database: In one aspect of the presentapplication the DaVinci Resolve Database is preloaded on a sharedstorage server, e.g., NAS device 100 of FIG. 1. DaVinci Resolve is anNLE that at its heart has a database, which stores everything about aproject, including user's preferences, and perhaps most importantlyuser's actual corrections and grades. For collaborative workflows, e.g.,a facility with multiple Resolve workstations or for an independentcolorist with multiple computers, there is a need for having a shareddatabase. With a shared SQL database, every Resolve computer can pointto the same database, and can access the same version of the project,without the export/import problems or the hassles of managing multipleversions of the same project. Using a shared SQL database allows usersto leverage Resolve's collaboration features, which allow multiplecolorists, editors and assistants to not only work on the same projectat the same time, but actually be working on the same timeline at thesame time.

In the prior art, the practice is to dedicate a separate computer to actas the database server. For example, this could be 2012 i7 Mac Mini. Thecomputer used as the database server should have a permanent static IPon the network. On the machine used as the database server, PostGreSQLshould be installed. The machine will also need to be connected bywires, for example, to a shared storage device directly or through aswitch, that can then fan out to the various Resolve users. The Resolvedatabase will then need to be configured so that it can be shared overthe network, all the while with no guarantee that this workflow setup isconfigured for optimal bandwidth, latency and stability.

The present application obviates the above steps by storing the Resolvedatabase on a RAID volume that is mounted into a shared storage server,for example, the NAS device 100. As shown in FIG. 1, the Storage Media180 comprises a separate Resolve Db Pool 183 for storing the Resolvedatabase. This can be exposed, for example, by the share application ofthe exemplary system, as a separate share volume to various workstationsconnected to NAS device 100, so that the users can then mount thisvolume to work collaboratively using Resolve. Thus, in one embodimentthe exemplary system provides a preconfigured DaVinci Resolve postgresdatabase stored on a RAID volume that is shared via the postgresprotocol that allows clients to access the database as well as the NASover the same connection RAID volume that provides redundancy and checksumming. Because the NAS is configured for a fast network connection,and multiple client workstations can connect to the NAS, the exemplarysystem facilitates all of the advantages of collaborative workflow thata Resolve database provides without the need for a separate databaseserver computer, wiring connections to switches or shared storage, andthe need to configure the database on the database server computer.

Digital content creation offers the ability to work together in waysthat were never possible before, so that work can be donecollaboratively, whether it involves a commercial, corporate piece,feature film, or web spot. Shared storage servers as set forth hereinallow teams of every size to enjoy the benefits of shared storage andcollaborative workflow that heretofore were out of reach or impractical.Such systems allow users to work natively and iterate quickly. A singleshared storage platform for ingest, editorial, VFX, finishing, andarchive such as the ones set forth here means quicker turnaround andtransparent media management.

In another embodiment, the present application comprises a sharedstorage server to store media, NLE, e.g., FCP X, Libraries and Cachefolders, and all other assets that are needed for post processing. Astorage system disclosed herein can work in demanding applications. Anexemplary system may provide a 100 TB effective and fully expandableenterprise network attached storage (NAS) system with high redundancyand high-availability for 24 client connections, 12 connections over 10Gig SFP+ to an existing fiber channel network for the editing stationsand the audio and ingest stations, and 12 connections over GigabitEthernet to an existing Cat6 network for extra ingest, titling andgraphics machines, Open Directory and system administration. The systemcan deliver sufficient sustained bandwidth to enable, for example, 5editing rooms cutting, rendering and exporting heavy multicam projectsin FCP X at the same time without any latency, plus one or more audiostations running video and multichannel audio from the server whilemedia was ingested to the server over high-speed connections fromdifferent sources, all at the same time. Moreover, the shared storageserver can easily integrate with the clients existing IT systems, whichmay comprise, by way of example only, MacPros running Mavericks and FCPX, MacPros running Lion for the AutoMotion software, different othercomputers including Windows based PC, a network system, Archive and MAMservers, EVS servers etc. using different protocols. Furthermore, to theshared storage server uses the right protocol to store NLE libraries,e.g., Final Cut Pro X Libraries, so that bottlenecks in the datapipeline leading to latency and beach balls on client stations, will notresult. The shared storage servers herein also allow all editing andingest clients to perform high-speed file transfers to the serverwithout affecting the sustained read bandwidth of any editing station,thus avoiding one of the biggest problems prior art NAS systems face inthis kind of setup.

The shared storage solutions provided herein have been optimized to meetthe demanding performance requirements NLEs, for example, the Final CutPro X Library Architecture and waveform/thumbnail caching and DaVinciResolve database storage. This extensive NLE optimization, allowsmultiple users to seamlessly work with the user's libraries, projectsand databases directly from the shared storage server and collaboratewith other editors across all of the user's clients as if these userfiles lived directly on SSD storage. As mentioned, the NAS of theexemplary system supports both NFS and SMB protocols for file sharing.

Although embodiments of the present application may be described andillustrated herein in terms of a network attached storage (NAS) system,it should be understood that embodiments of this application are not solimited, but are additionally applicable to other types of sharedstorage servers. Furthermore, although embodiments of the presentapplication may be described and illustrated herein in terms of devicesconnected over the Internet, it should it should be understood thatcertain embodiments are also applicable to other types of networks,including, for example, wide, metropolitan, and local area networks.

The shared storage servers of the present application are fullyinteroperable between and compatible with MacOS, Windows and Linux. Theyare optimized for FCPX, Premiere, AVID, Resolve, Motion, After Effects,Audition, Pro Tools, Logic. They support NFS, SMB, CIFS, iSCSI, FTP,SSH; are Thunderbolt 3 ready; support rsync and snapshot backups;support all major cloud backup platforms such as Dropbox; and can beremotely accessed over FTP or SSH.

Built upon a ZFS architecture, the operating system of the storagedevices/servers disclosed herein is designed to provide maximumperformance and data integrity with minimal management and maintenance.Through an easy to use GUI directory services (Active Directory, OpenDirectory, LDAP) can be enabled, snapshots and mirror volumesconfigured, encryption set, back up to the cloud performed, remoteaccess provided over FTP, and many other useful features.

Although embodiments of this application have been fully described withreference to the accompanying drawings, it is to be noted that variouschanges and modifications will become apparent to those skilled in theart. Such changes and modifications are to be understood as beingincluded within the scope of embodiments of this invention as defined bythe appended claims.

Terms and phrases used in this document, and variations thereof, unlessotherwise expressly stated, should be construed as open ended as opposedto limiting. As examples of the foregoing: the term “including” shouldbe read as mean “including, without limitation” or the like; the term“example” is used to provide exemplary instances of the item indiscussion, not an exhaustive or limiting list thereof; and adjectivessuch as “conventional,” “traditional,” “normal,” “standard,” “known” andterms of similar meaning should not be construed as limiting the itemdescribed to a given time period or to an item available as of a giventime, but instead should be read to encompass conventional, traditional,normal, or standard technologies that may be available or known now orat any time in the future. Likewise, a group of items linked with theconjunction “and” should not be read as requiring that each and everyone of those items be present in the grouping, but rather should be readas “and/or” unless expressly stated otherwise. Similarly, a group ofitems linked with the conjunction “or” should not be read as requiringmutual exclusivity among that group, but rather should also be read as“and/or” unless expressly stated otherwise. Furthermore, although items,elements or components of the disclosure may be described or claimed inthe singular, the plural is contemplated to be within the scope thereofunless limitation to the singular is explicitly stated. The presence ofbroadening words and phrases such as “one or more,” “at least,” “but notlimited to” or other like phrases in some instances shall not be read tomean that the narrower case is intended or required in instances wheresuch broadening phrases may be absent.

While the invention has been described in its preferred embodiments, itis to be understood that the words which have been used are words ofdescription and not of limitation. Therefore, changes may be made withinthe appended claims without departing from the true scope of theinvention.

What is claimed is:
 1. A method for configuring a client workstationwith one or more settings for optimum bandwidth, latency and stabilityfor file exchange utilizing SMB or NFS protocols over a local areanetwork with a network attached storage device, the network attachedstorage device having a memory with audio and video media footage storedon the memory and an operating system, wherein optimum bandwidth,latency and stability are selected to optimize performance of non-linearediting (NLE) software running on the client workstation for the purposeof editing audio and video media footage stored on the network attachedstorage device, comprising: using the operating system, creating in thememory a plurality of shares each having content including audio andvideo media footage and file transfer settings depending on the content;setting default permission settings for a number of potential users;connecting the client workstation configured to run non-linear editing(NLE) software to the network attached storage device; determining usingthe network attached storage device to extract from the clientworkstation one or more attributes of the client workstation; running anoptimization module on the network attached storage device to calculatea score based on the one or more attributes of the client workstation;using the score one or more attributes of the client workstation toconsult a database comprising optimum configuration settings for theclient workstation to determine the one or more settings for optimumbandwidth, latency and stability for file exchange of shares with thenetwork attached storage device; and modifying the client workstationsettings to be selected from the extracted one or more settings foroptimum bandwidth, latency and stability for file exchange utilizing theSMB or NFS protocols over a local area network with the network attachedstorage device; viewing on the client workstation a list of shares andassociated default permissions stored on the network attached storagedevice; mounting a first share stored on the network attached storagedevice to the client workstation; editing content located on the firstshare from the client workstation using non-linear editing (NLE)software.
 2. The method of claim 1, wherein the one or more attributesof the client workstation are selected from the group comprisingcharacteristics of the central processing unit of the clientworkstation, the characteristics of the memory of the clientworkstation, the operating systems of the client workstation, the speedand characteristics of the connection between the client workstation andthe network attached storage device.
 3. The method of claim 1, whereinthe step of extracting one or more client attributes comprises running asystem profiler for the client workstation.
 4. The method of claim 1,wherein the client workstation is directly connected to the networkattached storage device.
 5. The method of claim 1, wherein the clientworkstation is connected to the network attached storage device throughan intermediate adapter that combines a high-speed serial computerexpansion bus standard, a digital display interface, and DC power. 6.The method of claim 1, wherein the network attached storage deviceoperating system allows pooled storage, in which all available storagedrives are pooled together as a single resource, and includes datacorruption protection.
 7. A network system that is configured with oneor more settings for optimum bandwidth, latency and stability for fileexchange utilizing SMB or NFS protocols over a local area network with anetwork attached storage device, wherein optimum bandwidth, latency andstability are selected to optimize performance of non-linear editing(NLE) software running on the client workstation for the purpose ofediting audio and video media footage stored on the network attachedstorage device, the system comprising: a plurality of clientworkstations each being associated with a potential user, each potentialuser having a default permission setting, each client workstation beingconfigured to run non-linear editing (NLE) software; a network attachedstorage device having memory on which the operating system creates aplurality of shares each having content including audio and video mediafootage and file transfer settings depending on the content, the networkattached storage device further having an operating system; a connectionthat connects the client workstation to the network attached storagedevice; and an application residing on the network attached storagedevice and run by the operating system that during runtime extracts froma first client workstation one or more attributes of the clientworkstation and runs an optimization module to calculate a score basedon the one or more attributes of the client workstation, the applicationfurther using the score to consult a database comprising optimumconfiguration settings for the first client workstation to determine theone or more settings for optimum bandwidth, latency and stability forfile exchange of shares with the network attached storage device, andthe application further modifies the client workstation settingsselected from the extracted one or more settings for optimum bandwidth,latency and stability for file exchange utilizing the SMB or NFSprotocols over a local area network with the network attached storagedevice, wherein the application further enables a user on the firstclient workstation to view a list of shares and associated defaultpermissions stored on the network attached storage device, mount a firstshare stored on the network attached storage device to the clientworkstation, and edit content located on the first share from the clientworkstation using non-linear editing (NLE) software.
 8. The networksystem of claim 7, wherein the network system enables collaborativedigital content creation workflow and wherein: the client workstation isconfigured to run an application for digital content creation; thenetwork attached storage device comprises a fast memory storage poolthat can be shared with the client workstation, and wherein duringruntime the application can be set to use the fast storage pool forperforming one or more application functions.
 9. The network system ofclaim 8, wherein the application function is caching.
 10. The networksystem of claim 8, wherein the application function is storing alibrary.
 11. The network system of claim 8, wherein the applicationfunction is storing a project.
 12. The network system of claim 8,wherein the application is non-linear editing (NLE) software.
 13. Thenetwork system of claim 7, wherein the network system enables fileexchange and wherein: the network attached storage device has aplurality of ethernet ports numbered according to a numbering system,and wherein: the connection connects the first client workstation to afirst ethernet port on the network attached storage device; and theapplication is additionally configured during runtime to determine thenumber of the ethernet port that the first client workstation isconnected to and set the IP address of the ethernet port to its numberaccording to the numbering system.
 14. The network system of claim 13further comprising: a second client workstation; and a second connectionthat connects the second client workstation to a second ethernet port onthe network attached storage device, wherein an application residing onthe second client workstation that during runtime determines the numberof the ethernet port that the second client workstation is connected toand sets the IP address of the ethernet port to its number according tothe numbering system.
 15. The network system of claim 7, wherein thenetwork system enables file exchange and wherein: the network attachedstorage device comprises a first storage volume and a second fasterstorage volume, wherein one or more data files reside on the firststorage volume, and further including: an application residing on thenetwork attached storage device that during runtime determines the typeof data file being accessed by the client workstation and, depending onthe determined type of file, makes a decision about moving the data fileto the second faster storage volume.
 16. The network system of claim 15wherein the first storage volume comprises hard disk drives.
 17. Thenetwork system of claim 16, wherein the second storage volume comprisessolid state drives.
 18. The network system of claim 7, wherein thenetwork system enables collaborative digital content creation workflow,and wherein: the client workstation is configured to run an applicationfor digital content creation that requires access to an applicationdatabase; the network attached storage device comprises a storage poolthat can be shared with the client workstation, wherein the storage poolhas stored on it the application database; and wherein during runtimethe application for digital content creation can be set to use theapplication database that is stored on the storage pool of the networkattached storage device.
 19. The network system of claim 7, wherein thenetwork attached storage device operating system allows pooled storage,in which all available storage drives are pooled together as a singleresource, and includes data corruption protection.